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ABSTRACT 

Critical thinking encompasses the recognition of 
significant problems within a particular knowledge domain, the 
ability to systematically evaluate data through the application of 
various schema^ the ability to suspend personal evaluative biases, 
and the ability to construct, test, and communicate a final solution. 
Critical thinking is a skill which most educators expect their 
students to master, but, unlike reading, writing, or programming, 
critical thinking is viewed as something which one discovers for 
oneself . The best students do Seem to acgui re cr i t ical thinki ng 
skills without explicit instruction^ but many students require more 
explanation and coaching. Many current attempts to teach critical 
thinking, including unstructured Piagetian thinking exercises, the 
Socratic method^ and structured courses focusing on either 
doipain'specif ic skills or general skills to be applied across the 
curriculum, have not produced the desired result. Various research 
models , focusing on artificial intelligence; compar isonS ox expert 
and novice inf ormatioi; processing; logical biases responsible for 
Some systematic errors in logic; and the self ^referent effect , offer 
insight into the complicated process of hunian thought. Using these 
insightSp a program, course, ot technique may be developed for 
testing. (AYC) 
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Critical thinkinfj ir^ a ^^kill which most educators expect 
their students to mastcrp but unlike rt^adin^f^j writing or pro- 
camming very little direct instruct ion is e'^er provided . 
Critical thinking is viewed as something which one discovers for 
oneselfi something i,Yhich matures with time and exposure to the ap- 
propriate stimuli, something which is merely an extension of 
everyday thiriking-The Socratic approach illustrates these pre- 
sumptions; i-P the teacher aske the right anestions, the students 
will recognise relationships, identify the direction of the probe, 
and most importantly experience insight into the proble:ji ano its 
solution- However, no one is sure exactly bow this mysterious 
process takes place * 

What is certain is that for many students it doesn't take 
place; they require more — more explanation, more coaching, more 
something. The best students do seem to acquire critical think- 
ing skills withcut such explicit Instructiorti but even they may 
experience difficulty in translating problem solving skills from 
one area to another, even one which is similar (Riley, Greene &^ 
Hellert 1983; Kieras ^ Bovair* I986) . All students who have some 
difficulty with critical thinking demonstrate a systematic (if er- 
roneous) approach rather than haphazard errors (Resnick? 1935)- 
The latter would indicate confusion while the former suggests 
that even students who are considered poor problem solvers are 
practicing a form of logic which offers a foundation for improving 
thinking skills. Thus, the consensus that we ought to *'teach*' 
critical thinking (W.J. Basic Skills Council, I986) . 
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This conclusion I . interestingly # is symptomatic of one of the 
majcr errors in critical thinkings to seek a solution before one 
defines tile problem and decides what questions should be asked. 
Redefining the question and identifying the underlying assumptions 
and implicit knov^ledge requirements is one of the problem solving 
strategies which seem to account for the greater success and ap- 
parent ease of "expert" critical thinking (Chip Feltovich & CJla- 
ser» 1981). An "expert'* would aski What is critical thinking? 
What do we already know about successful and problematic approaches? 
What do we v/ant our students to be able to do» to do differently^ 
or to do better? What is the best strategy for accomplishing this? 
By the time we sort out ansv/ers to our earlier questions ^ the 
answer to the last (i.e. how to teach critical thinking) should 
become apparent (i.e. insight sho'ild occur), and perhaps we also 
will have learned how to model critical thinking more explicitly 
for our students* 

The above questions will not be fully answered in this papert 
as the task of simply surveying the diverse research on thinking 
strategies is greater than an article of this length permits. 
Kowever, I will attempt to redefine the problem to some degree and 
identify some of the current work relevant to the goal of improv- 
ing critical thinkings to offer some suggestions for f u: ture 
exploration . 

The first question to be raised is: What is critical think- 
ing and how does it relate to other thought processes? The abil- 
ity in question has been variously labelled as problem solving: 
logical # academic or critical thinking (Henle p 19^2 ; Press eisen# 
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1986). However* the accompanying descriptions of process and 
function are congruent indicating these may be treated as tho 
same skill rather than as different types of thinking. To sim- 
plify matters I I will refer to all of the abave as critical 
thiafcing* Critical thinking encompasses the recognition of 
significant protlems within a particular knowledge domain* the 
ability to systematically evaluate data through the application 
tjf v^arlous schema or potential solution plans and empirically 
check the reasonableness of each, the ability to suspend personal 
evaluative biasesi and the ability to construct^ test and communi- 
cate a final solution* 

Several researchers (e,g. Bobrow & Browni 1975* Chi, Felto- 
vich & Glaser» 19B1 k .Resnick » 1985) propose that critical thinking 
Combines both top-do\?n (schema- driven) and bottom-up ( data^-driveo) 
proc esses in c omplementary cycles although the balance between 
these two approaches may determine the degree of success to some 
extent- In comparison of expert and novice problem solvers^ Chi, 
Feltouich a; Glaser (l98i) have attributed the e>rperts* greater 
success to more emphasis on identifying underlying schema or prin- 
ciples In outlining a solution [i*e, top-down); in contrast, 
novices stick very close to the data and derive more superficial 
solutions (i.e. bottom-up) , 

Underwood (1952), Henle (1962), Lawler (1981) and the N,J, 
Basic Skills Council (198^) express the belief that critical 
th.inking differs in important ways from those thinking skills we 
utilized daily. Henle best sums up this difference. Logical 
thinking is an ideal, a criteria against which we evaluate other 
forms of thinking- It is how v/e "ought" to think, but It is not 



4 



how we actually think in daily "real world" activitier^. In the 
''real world" we are biasgdr we allow our emotione, motivations, 
and intuitions equal time with our more rational xunctionsi and 
if we perceive the world the way we wish it to be, or act unon 
our feelings* or stress "what makes senoe" within our phenotneno- 
logical sphere, we may be no les? (and perhaps more) effective 
than if we dealt with the world within an obijective, logical 
framework. For if v/e know ourselves to be occasionally irrational 
and illogical, we Know that others often are S0( thus* we deal 
with people (including ourselves} as they are rather than as 
they might be or as we would v/ish them to be (i-e, rational). 

In con±raGt to this imperfect wor.^dp v/e seek to create a 
more idealised world in aoadeniia, We try to strunture, to define, 
to manipulate or experimentally control* to discover the funde- 
mental principlej^ . of our rgspgctive disciplines and those con-- 
ditions capable of altering basic rules. As we try to be more 
critical and precise in our scholarship, we stress those qualities 
associated vjith logical or aritical thinking (Presseisen, 1986; 
N,J, Basic Skills Council, 1936) and ask our students to do some- 
thing different from what common place activates require. 

If we accept the assumption that critical thinking differs 
from other more common thinking skills, snd is not easily 

abstracted from experience by many studeats p the next question we 
must raise isi Can critical thinking bg taught and if so, how 
should we approach it? Both the N,J, Basic Skills Council (l986) 
and Presseisen (I986) list current attempts to teach critical/*^ 
These approaches , which include unstructured thinking exercises 
(a la Piaget) t the Socrat;ic method, and structured courses 
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focusing on either domain^speciflc skillv^ or ^^.eneral skills to he 
applied across the curriculurni have not produced the desired 
results ^ 

Unstructured Plage tian exercizes have failed to instruct 
the average student in those skills which a Piagetian would la- 
"bel formal operations (i,e, logical or critical thinking). Sixty 
per cent or more of the population are assigned to the concrete 
operational level, unable to utilize critical thinking skills^ 
However, further investigation suggests that this may be a super- 
ficial and limited analysis » that people may progress on to for- 
naal operational skills » but only in areas of specialization or 
narrowiy— defined- rnrteresl7 (Stevens-L6ngr 198^+). This means that 
in those areas of expertise where students are more rigorously 
and specifically instructed* formal operational skills (which 
usually do not generalise to other academic areas) may be achieved. 
Still individuals may be typed as concrete operational if not test-- 
ed in their area of expertise. Is this merely a testing problem 
do such rigid domain-specific skills fall short of our proto^ 
type of -the critical or logical thinker? 

The Socratic method as pre\riously mentioned seems to rely 
on the ability of the student to a.bstract a method of critical 
evaluation to be generalized later to other subject matter from 
hints (i-e, teacher initiated questions) which often seem to go 
unrecognised by students- 

The verdict on structured thinking courses (either general 
or (omain^specif ic) is still out because frequently such courses 
have merely recycled techniques which we have found to be inef' 
fective or partially so. The question remains? Can we offer our 
students who are unable to extrapolate from th€. abstract 
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a more explicit; coaching format? iiow do wc do this*; Is there 
anything new v;e haven't tried? 

Resnick (1985) citeG a number of research studies nhich 
suggest dif ferent perspectives and perhaps some new strategies - 
These include artificial intelligence ( AI ) models and com par i^ 
sons of expert and novice information processing* 

Artificial intelligence studies seek to develop computer 
programs which can *'think" or "solve probl-^r^ig" and generate 
models of human information processing (e.g- SCA (Bobrow ^ 
Brown, 1975) » ACT (Anderson, 19S2) , ABLE (Larkln, 1986), SOAR 
(Laird, Rosenbloom & Newell, 1986)). Such programs are detailed 
simulations of human thinking which attempt to model how knowledge 
is structured and accessed and what procedures and heurxsJtics 
are used in manipulating it. 

AI studies the process of building coherence (or linking 
information, recognizing missing propositions and infering them) # 
memory storage and retreival including capacity, operating time 
and automaticity , schema or prototype formation and usage, both 
top-down and bottom-up organisation strategies and their inter- 
play, syntax (i-e, rules) and semantics (i,e, symbolic represen- 
tation), and systematic errors and complementary "repair pro- 
grams". Eariier research in this field focused on knowledge- 
poor task environments I i . e minimum information not provided 
within the problem statement was necessary) and sought to develop 
general domain-independent methods, ^lore recently AI studies 
have: included more domain-specif ic situations and haif'^^ questioned 
the versatility of general rules* 
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lifhile no model has achieved complete success, each seems* 
capable of explaining a part of the complicated process of hunian 
thought, and such simulations (e,g, Gick ^lolyoak, 1983? Rileyi 
Greeno ^ Heller, 1983; Burnsteirit I986) also shed some light on 
systematic errors in logic? in general, these errors seem to be 
the result of either inc orrect procedures which are variants of 
correct ones (i^6. incorrect rules sometimes called malrules or 
"^^ggy algorithms" because of their similarity to malfunctioning 
computer programs v^hich require debugging) or incomplete or faulty 
imderstanding of the problem statement (i*e^ a communications 
breakdown)* The regognition that computer generated models can 
duplicate human errors without producing additional ones unrepre- 
sentative of human thought offers some support for both the valid- 
ity of the simulations and the assumption that "illogical" think- 
ing does follow a pattern which if understood might assist in 
learning to recognize and correct such errors or "debug" a 
student's faulty logic. 

Comparisons of experts' and noifices" critical thinking be- 
havior in a variety of domains such as mathmatics (Lav/ler, I9SI), 
Physics {di Sessa, 1982? HcCloskeyp 1983) f politics {Fiske 
Kinder, 1982), baseball (Chiesi, Spilich ^ Voss, 19?9) and chess 
(Newell & Simoiij 19?^) inay provide a different model for instuction 
in critical thinking and ansv^er the question* ',ifhat do v/e want 
our students to be able to do? 

First, the expert/novice model highlights the importance of 
domain-specific knowledge; the expert alv;ays knowa more facts p 
more relationships between facts and more previously successful 



Isolations than the novice. Although quantity and quality are in- 
extricably lin]:ed and together may explain th^ difficulty in tran:^- 
ferifig critical thinking skills from one domain to another and 
the domain related differences in testing for formal operational 
thinlcing, how th*^ expert organizes this infomation seems more 
significant than its q'-jantity alone- 

The expert's ^eatcr knowledge m^y result in tighter organi- 
zation which may increase the capacity of v;orking memory 
(STM) and thus, the probltm sol , vers ability to consider and com- 
pare a variejiy of relevant thouglh seemingly infionsisten-t facts 
simultaneously and develop broader schenia or problem sol^tng stra- 
tegies. In contrast, a novice who requires more space in th^ STH 
for less organized information also may require more time to pro- 
cess relevant data v/hich necessarily must be done in cycles which 
try different permutations but can never include all the relevant 
information at the same time (ite. contiguously). Thus, the 
novice may nerer see a vital relationship necessary to sol'/e 
the problem. This suggests one explanation of why novices both 
take more time to solve a probleni and sometimes miss the critical 
linch pin of a solution (Fiske et al.* 1983) 

Experts also may recognize relevant variables more quickly 
because of their greater familiarity v/ith the domain and greater 
confidence in their retreival skills. Chi et al. (I9OI) found 
that v/hile experts and novices produced similar results when aGked 
to circle the key concepts in a problem statement \vhich could con- 
tribute to a solution, experts circled fewer key words ahov^ing 
greater selective recognition of the problem requirements- 
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similarly, Reder & Anderson (l98o) propose that experts may 
ha'^e more previously completed solution:;stored in memory and are 
able to produce these ansvrer; units readily while novices must 
build them and that due to recognition of correlation:^! experts 
create stronger associations when facts are stored in memoryi and 
these stronger associations result in more efficient r£i;reival 
and thust shorter reaction times. Chiese et al \19?9} report 
that experts were able to recognize relevant changes or new jna- 
terial in a problem statement more often and required lees infor-- 
mation to make recognition judgments than did novices* 

In addition to tighter organisation and the resulting more 
efficient storage and retreival, experts also exhibit a different 
approach in organizing the problem spaj,<ie (i.e, defining the 
question(s) to be answered, relevant data, and any contextual 
restraints). Chi et al- (I98I) cite dif f erences between experts 
and novices in the four stages of representation originated by 
McDermott & Larkin (1978)- 1) literal representation; 2) naive 
representation; 3) scientific representation; and 4) algebraic 
Cor symbolic) representation. Novices fixate on the first tv;o 
stages \iith some attention occasionally given to stage 3i 't^hey 
stress the importance of the terms "^^ed in the problem statement. 
Propose solutions which literally include them, and look for a 
strategy which will link the two, sorrietiiiies without any real un- 
derstanding of how or why: these solutions are often referred to 
as naive theories (e.g. McCloskeyi 1983) . This also might be il- 
lustrated by the math student who has the problem, thinks he 
knows what the answer 5=;hould look liKe and is seeking the inter- 
veiaing calculations. 
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In contrast, exports focus on stages 3 ^r^cl ^; they attempt 
to categorize the prob-Lcm according to their k-no-.vledge of the do- 
.•T^ain. Rathor than focusing immediately on tho nolution (i.e. 
v;hat*s the rl^ht answer?), they focus on the problem statement 
and asic-. ';/hat do I need to knov/ to solve this problem? Is all 
the inrormation available in the problem statem^nt^or do I need 
to add information (from my ov/n knowledge bascj which the question 
implies or assumes I will recogni7;e the need for? What principles 
or strategies from my past experience with the domain are needed 
to answer the question? 

In this fashion the expert uses his greater domain-apeci£lc 
knowledge and experience to reorganize the problem statementt this 
transfonnation adds derived (or second-order) features vfhich the 
novice doesn't access, and these added features usually clearly 
plot the solution O'^th so that the ansi^er ^en becomes obvious 
(i.e. insight occur^) . Meanwhile the novice often is stuck with 
apparently con7?licting facts or a solution strategy v;hich "makes 
sense'' intuitively but can't encompass all the data or doesn't 
quite fit which is vei'y frustrating because the novice kjiows 
that answer has to be right* is the only possible one (closure) 
and thus, continues to plod along in the la^e of illogic and 
obvious" error* 

While these descriptions may infer that experts use top- 
do\7n or schema^driven organizational strategies exclusively and 
novices are limited by a bottrni^up or data-driven approach, Chi 
et al., 1979) suggest that the expert uses a combination of botn 
strategies vrhich increase ef f ecti xness - One possible difference 
proposed by Chiesi et al* (l979) is the Problem's goal structure. 
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Novicec ignore or are unav;a:re of thi^^ and experts use it as an 
GAaluation criterion. By keeping eight of the goal of the prob- 
lem and coatinually checking rie^v information and potential strate- 
gies against it^ the expert is creating an interaction between 
the problem and the knowledge base which taps both declarative 
(i*e, factual) amd procedural (i,e- what to do with it) knowledge 
and monitors the de^j^elopment of schema for omissions and faulty 
strategies - 

Thus, identifying and modeling expert problem solving stra- 
tegies if combinsd with an emphasis on metacognition* (i - e - self- 
monitoring) to heighten awareness of what the thinker Is doing 
and what he or she should be doing could improve critical think- 
ing skills? however, this approach v/ould limit itself to domain- 
specific courses and woiald not support teaching across the 
curriculum _ 

In addition to the two areas of research detailed above, 
there are several others of potential interest. Space allovifs 
only a breif mention of two examples j logical biases responsi- 
ble for some systematic errors in logic and the self -referent 
effect, in particulart %vhich offers some insight into differences 
between individuals in interpreting the problem statement, en- 
coding and retreiving information, and judginis: the relevancy 
of propositions , 

Lo!2:ical biases which have been identified are: a tendency 
toward closure (i,e, excluding alternate solutions in favor of 
only one probable solution too early in the evaluation process), 
a tendency toward verification once a strategy is selected (which 



ERIC 



13 



makea it difficult to replace an un^^uccessful i^tT3.tQ^) ^ a tenden 
toward similarity, the atmosphere effect (responding with a posi- 
tive solution to positively stated propositions and v/ith a negati 
solution to negatively stated ones , , cs pecially in the case of a 
double negative),, a tendency to seek causality, a tendency to 
weight emotionally charged propositions, a tendency to remember 
material one has added as part of the original problem statement » 
a tendency to consider goaXs, outcomes^ and motives as central to 
understanding a problem, a tendency to confirm expectancies based 
on past experiences, and the self -referent effect. (a tendency to- 
ward egocentrism) - The last is of particular interest in psycho- 
logical reasoning as potential self-referent material is heavily 
represented in psychology course content. 

Rogers, Kuiper & Kirkes (l9?7Jf r/Iarkus (19??) f Bowerman 
(1978} , Bower & Gilligan (1979) f Lord (1980), Mancuso & Geely 
(I980J, and Marks Cl98^) offer more insight into the self-refer- 
ent effect, and Janis & l^rick (l9^3)i >':organ &^ Morton (194^), 
Lefford (l9^6)< Thistlethwaite (l950), Henle (l955)f llenle & 
Michael (1956), Gough (I965), Jones (I966), Wason (1968) , Green 
(1970), Evans (l972) , and Wason £: Johnson-Luird Ci972) explore 
one or more of the above logical biases. 

While this paper may not detail an answer to how we teach 
critical thinking, I balieve it may help to flesh out some of 
the questions regarding what we v/ish to accomplish and what we 
might try as alternatives to v;hat we've been do:ng- A critical 
thinker has to select out and Organize the relevant data (which 
I have initiated) and then construct a representation of the 
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problem (which I am in the process of rloing) and finally instan- 
tiate a solution {i-e- a Brogramt a course^ a technique) to be 
tested. Only in the application of potential teaching strategies 
can WG le&rn their value. (This is the eventual goal of this 
Paper. ) Recent articles (e.g. Press eiaen, 1986; N.J. Basic 
Skills Council, 1986) have raised the questinns of the need and 
justifications for critical thinking and have surveyed the cur- 
rent status of the teaching of critical thinking- Perhaps, this 
article may offer some alternative^ suggestions regarding the 
next step to be taken* 
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